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ABSTRACT 


The purpose of this thesis was to apply computer compatible 
decision techniques to the problem of selecting a recipient for 
ere Rear Admiral John J. Shieffelin Award for Excellence in 
teaching ac the Naval Postgraduate School. 

Ееее еси пе ено срп сасе меке used to analyze the 
data from the ballots. The balloting process is described and 
computer programs are presented. Special studies were made 
using Kendell's coefficient of concordance. Their purpose was 
POowlnvestigavew@me Issue of whether students and alumni rank 
MN cM members in Che same way. Іп addition the ranking of 
faculty members across years was studied. The results of this 
part of the study was Be Ома statistical basis, 16 canbe 
stated that the student and alumni ratings of faculty are 
Amar and faculty rankings have been stable over the three 


years the award has been presented. 
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I. INTRODUCTION 


In this paper the history of the Shieffelin Award for 
асе ц О се її aching at the Naval Postgraduate School is 
discussed and the process involved in selecting the winner 
is explained. This process of selecting the outstanding 
a relezsconsiscean or,desıen and distribution of ballots, 
AGCO ballots, collection of data, ОК Ор рег тсе 
techniques аа to analyze data. These techniques are ex- 
plained and the results are examined later in this thesis. 

Nos patas tica ls Cua Tes were conducted. The first was 
Bond termine ir Ssemoents and alumni within this years 1972 
voting population ranked teachers in a similar manner. The 
second study was made to determine if the ranking of teachers 
(by students) this year was consistent with the ranking of 


teachers (by students) in all previous years. 





ШІ. ТЫН COMMITTEE 


The Award for Excellence in Teaching was established in 
May 1969 by Rear Admiral Robert W. MeNitt, USN, and awarded 
for the first time in June of 1970. At the time that the 
award was established a faculty committee was formed. The 
ОШ Ctive of Chis committee was to select a recipient for 
the outstanding teaching award to be presented each year 
eurer che June sradustion exercise, 

the superintendent of the Naval Postgraduate SCHOOL, 
Rear Admiral A. S. Goodfellow, USN, on 1 March 1972 sent a 
letter to the Кш members or the 1970 eraduation classes. 
Part of this letter stated..."This June an award for excel- 
Tence an teaching for the third time will be given to a member 
ее Рае ву. Civilian or military. This award is mow known 
as the Rear Admiral John J. Shieffelin Award, and was made 
possible through a grant to the Naval Postgraduate School 
Pounda tiOn Ргетоцв inne rs ой The award are Professor 
ID ero паше Department of Physics and Professor 
НЕ Пе e deve cctstne Department Ol Oceanography. The 
CCI ы еы есп ееспшеуваг сртоцећ а careful poll гаки 
among alumni, students, and faculty." 

This years recipient of the award again was selected by a 
committee of seven faculty members. The committee was com- 
posed ori 2 Chairman, Professor D. B. Hoisington; a бесге е 


x G j Ciro SSO Р. J. Renard, and five other member 





ов. М. БО, С. к. Jones, Professor 
7. М. Dyer, and Assistant T Пе о Боан а па а а 
Musgrave. 

The members of this committee are selected to provide a 
wide variety Of backgrounds and curricula. Four persons 
Ве ее committee each year and are replaced by four new 
members chus, ensenderinge new ideas and. concepts in the 
selection process while retaining a core of persons familiar 
Nikon ПЕ Ехпесіте system, 

ПИВА ЗЛИН аи сан CNC солт сее саесаеа To retain the 
Same philosophical outlook concerning the nature of excellence 
месо nina alone wich how excellence in teaching should be 
reliably identified and evaluated. The interested reader 
will find this outlook in a previous Naval Postgraduate 
school thesis. To set the groundwork for this paper certain 
eurdaelines Гог T SClCCCEIGI PIOCESS VILL DE COISCUSS dS These 
Guidelines are as follows: 

lI“ Ali faculty with Lhe exception of the Department 
Chairman, Administrators, members of the selection 
committee, and previous winners are eligible to 
Receive ерте” апара, 

2. The voting population includes all current students, 
facade Clr io were Officers. Also ancluded in 
БО ШОГО ог ауа Ofrieers which graduated ig 


Or 


сц марака расце ENC DOLL Is’entirely voluntary and 
Demon жаш y Jl fi Oo Sign ше Башта. 


Robert М. Geary, "The First Annual Award for Excellemes 
in Teaching, A Study of Procedure and Analysis of Data" 
(unpublished Master's thesis, U. S. Naval Postgraduate School, 
Memeereystaliiornla, 1970), р: 10. 





4. Care and discretion are used to ensure no ranking of 
candidates is published. 


5. For the ballot to be valid the voter must indicate that 
he is acquainted with at least five members on the 
candidate list. 

6. The voter is cautioned not to vote on the basis of 
Ben oma Ol рор агтуу but on teaching ability and 
performance. 

In order to maintain objectivity among the selection 
committee it was determined that an individual from outside 
the faculty would handle the ballots, collate the data and 
submit the results to the selection committee. 

Only after the committee selected the nominee for this 
years award was his name made known to the selection committee. 
The nominee's name was then submitted to Rear Admiral A. S. 


(а ве оте final approval, and remained a secret to all 


Others until the award was presented at the June graduation. 





ца. THE BALLOT 


А. FORMAT 

Is pelearon ӘПЕР vas attached to the front of the 
Ballot to explain the purpose of the award, give instructions 
Como ve comeletewrhe Dallot, and explain the requirements 
for validating the ballot.“ 

The ballot itself was composed of four parts. Part A was 
a Data Processing aid to help in the analysis of the voter 
population characteristics. The voter was asked to identify 
ШШ О ег? Category, Rank, Branch of Service, and Curricular 
EC c Military cun Can his academic ranked department 
Ecco cDecerreded. 

Part B included three blanks to be used in indicating 
wirst, second, and third choices for the award using the four 
Nc identification number in Part C. 

Part C of the ballot identified all eligible faculty 
ЈИ ис с ом еў each voter could select his first, second, 
and third choices. Each eligible faculty member was listed 
mi alphabetical order under the heading of ПИ ератг теп. 
The voter was asked to circle a four digit identification 
number of all those faculty members with whom he considered 
himself to be reasonably well acquainted in an academic 


Capacity. 


en sample ballot and instruction sheet are included in 
Appendix A. 
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Mas porten or the ballot, Part D, was to be used 
ПОС СОШО езе reasons Lor his selection. This portion 
Was not mandatory, but was considered beneficial in the final 


selection processes. 


Bee НЕ BALLOTING PROCESS 

Бао шеге dasprrbutred to students by utilizing the 
student mail center (SMC). The alumni group selected to 
participate in this years voting were the Naval Officers who 
graduated in calendar s II ира а 
were taken from a data tape maintained in the computer 
шас су. 

Mea a or adad Essinge alumni ballots, a computer 
Юрга Was written which can be used in the future. The 
пе“ tape can now be sorted by commands so that all 
praduates with similar addresses will be listed. Оп the 
basis of this years alumni sample this should mean a savings 
about 202 in over all look up time since this process is 
Gone by hand the saving in time is important. 

Faculty ballots were distributed by the members of the 
committee to the appropriate faculty mail center locations. 
ATEO tana | о ле completed ballot was placed in the 

attached envelope addressed to the Superintendent of the 
Naval Postgraduate School and mailed to the committee member 
in charge. The envelopes were coded 55 BAL to help route 


them to the person assembling the data. 


rei 








С. BALLOT VALIDATION 
1. Assembling the Data 

As the ballots were returned the validation process 
Tor each ballot becan. Each envelope contained an area for 
the voters Signature, this was considered important to ensure 
that only one ballot was received from each voter. The 
envelopes and cover sheets were then discarded. 

The validation process encompassed counting to ensure 
нег Ресор стог che Dallot пай at least five identification 
ив tear leds ana (пе nominations for 11986, second, and 
third place were valid nominations. If less than five identi- 
Macon Om mumpers were cireled in Part C the ballot was 
enn o dered void and eliminated from the voting process. 

The committee decided that when a voter gave all 
pacceovoves to the same teacher that the second and third 
cece сес would be nullified. Each ballot was then given 
еле Сер LCeitaileavion number so that specific data could 
кеге гче е а а later time, | 

ОГ 1,319 ballots returned, 148 were deemed void 
6 n population of five persons wás not specified by the 
voter, and nine were returned too late to be processed. In 
last years voting ballots were deemed void because of write-in 
nominations of ineligible faculty members; however, this year R 
СОЕ ес косе to process the ballot as valid if the otnes 
two votes vere valid, 

The number of void ballots has in the past been at 


buted to the large number of first auarter students; however, 
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of the 148 void ballots, 5 failed to identify their voter 

category, 79 were students, 40 c duum 23 were faculty, 
and 1 was a curricular officer, thus 37% of all void ballots 
were from the non-student population and could not be attri- 


Búveda to first quarter students. 


1 





IV. STATISTICAL ANALYSIS 


A. "TRANSFERRING DATA TO COMPUTER TAPE 

After the above validation process was completed, the 
information from each ballot was transferred to punched 
cards. These data cards were then processed by a COBOL 
computer program called "TRANSFER"? which: 


Check MOr RED UNEN errors. 
Checked for a population of at least five teachers. 


Gave a printed output of all ballots which contained 
errors. 


Ц. Transferred the data from ballots which contained no 
errors to a magnetic computer tape. 


The techniques used by "TRANSFER" to check for errors was 
Based on the four digit identification number assigned to 
ео Бо алс, Tbe first three digits ot eaeh 
шасита i cation number assigned to each teacher on сложе lot 
formed a vector, N, which when multiplied by a fixed weighing 
vector, S, formed an inner product. The last digit of this 
Miners product IONE спе fourth digit of the identification 
number. 

шага Cal dS teacher With an identification number 
of 2934. The digits 293 identify the teacher, while the last 


digit ДІ ts the result of the last dipit In the inner produce 


S 
(293) 5 = 6+15+3 = 54 
1 
ЗА Piece Sar: is included in Appendix B. 
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аша сес сіце сап be Checked for correctness using an 
error detection system where the inner product is computed and 
compared against the fourth digit of the identification number. 
invanımber which was typed in error, or any nomination which 
the voter may have copied incorrectly from the ballot would 
be detected. Only after ame number on each ballot was 
checked would that ballot be transferred to the magnetic tape. 
Anytime a number was in error a message would be printed 
giving the ballot number and the cause for the rejection. 
Corrections would be made to the appropriate data cards and 
"TRANSFER" would be run again until all valid ballots were 


recorded on the magnetic tape. 


Eee POPULATION CHARACTERISTICS 

With all valid ballots recorded on tape it was possible 
Bozebstraet data irom this tape which would give a breakdown 
um ucechanraeterrsuliecs Of the voting population. One of the 
major goals of this years committee was to increase voter 
месиоиве, 50 che maximum possible extent. The percentage 
of response was determined for each voter category for both 
КОЕ ед 9/2 cand last year 19/71. Table I. below lists the 
breakdown of this years ballots. 


Table T. Ballot Breakdown 
% Increase 


Voter Category No.Eligible No. Valid % Valid Over Pre- 
Voters Ballots From Eligible vious 
Student 1700 702 те (12. 
Alumni 580 350 ЕШ». 1488 
Faculty 308 106 34.4 0% 
асе таць рае 16 5 BS ec C 
Alumni & Students 2280 1052 ЧОО (бш) 


() Indicate a decrease 
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The last column compares the difference in the percent of 
valid ballots returned from the eligible population for this 
year and last. The table shows that there was no change in 
the percentage of curricular officers voting, while the 
percentage of students voting dropped, and the percentage of 


alumni and faculty voting increased. 


C. CLOSER OBSERVATIONS 

Further information concerning the voter population is 
contained in the following set of TT bles Ta ble (IT pre ento 
a breakdown of faculty voters by curricular department and 
academic rank. The columns indicate the different ranks and 
rows indicate academic department. Ву scanning the Jth 
column and Ith row, a determination of the number of valid 
ballots from faculty of I department and ol J rank can De 
determined. 

Tables III, IV, and V give a breakdown of military voters 
by Branch of Service, Rank, 209 (ссег Category: Table V 
also includes eivilian students and alumnus which attended 
the defense management school. The Lens teo luna. represents 
E civilian students and 16 civilians. The students votes are 
included in the percentage of student votes То пар смера сен 
area. In each table the Ith row gives the curricular area and 
Jth column gives either the Branch of Service, Rank, or Voter 


Category. 


16 
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DABLE DANCE OF SERVICE 
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Operations 129 
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D. DISTRIBUTION OF M, 

A second COBOL computer program called "PROFSORT"" was 
run. Its purpose was to reorganize the data from "TRANSFER" 
into records for each professor which is identified on each 
ballot. This new record-file is organized by ascending 
Pregessor number. М, is defined as the number of eligible 
faculty members known by the ith voter. 

Table VI presents a frequency table of Ms. The mean 


number of faculty members known by the voters was 17.7 and 


the standard deviation was 11.6. 


Table VI. FREQUENCY TABLE OF М. 


CR FREQUENCY 

en, 204 
“10-14 321 
15-19 216 
20-24 166 
25-29 m 
30-34 47 
о T 
40-44 10 
45-49 6 
50-54 Д 
Sec 1l 
60-6! 2 
65-69 2 
70-74 1 
ос 1 
80-84 0 
85-89 0 
90-94 Д 





А А listing of "PROFSORT" is included in Appendix B. 


zal 








Е eect AL BUTTON OF N 


K 


ВНЕ COBOL Computer program called "асовзовт" 2 used 


ил sorted dala produced by "PROFSORT" as input. Тһе 


EC COR ORT program determined the distribution of N the 


number of voters who knew the Kth professor. 


К? 
fable Vil is a 


frequency table of Ny and figure 1 presents a histogram of 


Nye 


вен a standard deviation of 43.4. 


The mean number of voters who knew teacher K was 70.5 


А шеге Line тас 


БИ шу che Tresueney table ol Ny is that one professor 


was known by 274 voters. 


> 


Maple TT. 


CELL 
1- 24 
26- 50 
Sa 
76-100 
102125 
126-150 
РН > 
176-200 
201-225 
226-250 
e > 





FREQUENCY TABLE OF N 


FREQUENCY 


n 
T5 
99 
40 


725 


16 


K 


п ПОЕТ" is included in Appendix B. 
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Figure 1. HISTOGRAM OF Nx 


Another important result determined by "SCORSORT" was 
Иш Кре ош ce pot each teacher, Ту. AMDn oUt Oi ThE КЕЙ 
teacher's score, 5,» is given. Sy is determined in "SCORSORT" 


ar oO] Lous: 


X evel number O1 first place votes for Тк. 


1K 
Хок = Total number of second place votes for Тк. 
Хақ Mota umben oi Lhd place votes [ог Тұ. 


Xy Хок; Хақ were each divided by Му» the number of 


persons who identified Тк ШіғРара С ор спе ballot, yielding 


a vector Ук. 
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V, was multiplied by a weighting vector W, where 


W= (4,2,1), and the product was the score, Зк› Гог teacher K. 


2. = (X асн хк =) 


TE 


Table VIII presents a summary of the "SCORSORT" printout 


showing K, Sy» Мк» Ly ХК: Xu and Хақ respectively. 


F. DOMINANCE 
The fourth COBOL computer program called "DOMINANCE"® 
used the results generated by "SCORSORT" for input data. This 


data included 


Xl = The number of Ith place votes received by teacher K. 
Ny = Number of: voters who knew Ту. 
Vix = Хтк/ Мк = Fraction of Ith place votes awarded T, by 


кер рор асов OT VOLES that knew him. 

The purpose of this program was to reduce the number of 
eligible recipients by two methods, (1) absolute dominance and 
(2) complete dominance. 


1. Background 


т Sy» the score of teacher K is represented Dy 


3 
Sy = E Уту where W = (MW, > Wy > Из) is а 


verening vector Such Chat 


\ 


W > W, > М. ao. (1) 


Sp а © аба. Is included in Appendix B. 
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TABLE VIII. SCORSORT SUMMARY 


K K K 1К 2K 
‚92157 51 98 | ү 
"ES 58 103 23 3 
"росе 29 51 9 6 
SS 68 107 20 dm 
.50000 68 102 17 13 
Коро 108 159 30 j. 
. 43478 69 99 19 10 
. 35238 105 12 21 16 
. 30991 1771 221 36 31 
. 26446 Е 153 24 23 
24234 71 92 14 i 
aa 71 92 21 2 
TTo. 41 48 7 7 
13043 28 26 5 2 
.11 2] 106 118 20 15 
0E 56 62 12 
. 10606 66 T 12 10 
.08824 ШЕ ¡MA 18 15 
‚05882 ЗД. 36 6 Д 
2057151] De ED 9 6 
‚05128 78 82 ү 6 
. 00000 83 ‚ 83 14 9 
. 00000 а 27 5 3 
„94731 э 54 ү ШЕ 
‚90805 87 79 10 16 
‚90196 51 46 10 || 
. 89655 116 104 19 10 
2900595 86 Ta 11 13 
. 89130 46 41 Т 5 
‚88889 15 40 .6 5 
„88722 133 Jj. 22 10 
. 2 79 69 15 E 
‚86364 66 57 10 4 
84046 03 79 Ш2 e 
.83077 65 54 10 5 
‚82553 235 194 32 2u 
аа, 104 85 15 8 
201553 103 84 2 T2 
‚81132 53 43 1 6 
‚80000 55 yy 6 6 
. 76860 M21 93 E? 15у 
‚75781 128 Om 16 13 
. 15000 28 21 3 Д 
‚74138 Be 86 16 8 
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TABLE VIII. SCORSORT SUMMARY (Continued) 


Sk Nhe 27 К Хок Хок 
ee 30 22 Д 2 2 
„172973 7u 54 5 ТІҢ! 12 
ео) 13 E 9 5 6 
‚63380 ml 5 10 1 3 
‚61165 103 63 10 9 5 
‚60465 129 78 9 17 8 
22212 86 51 6 12 3 
. 58974 39 23 4 2 3 
‚58108 74 43 5 10 3 
г 85 19 8 H 9 
OUEST 61 35 ©, 6 3 
. 56944 Ир TS 5 8 5 
‚56140 57 32 3 8 Ц 
‚56000 75 Ц? 6 7 Д 
‚5332 59 52 5 5 5 
‚55263 38 21 Ц П 3 
‚55245 143 79 ja: 12 ШІ) 
. 54545 22 12 2 1 2 
‚54015 ШЕТ 74 11 11 8 
‚53846 26 ПЦ 2 0 6 
21210516) 66 35 5 6 3 
522652 ДІНДІ 58 6 12 10 
250923 52 27 Ц 3 5 
„51282 У 60 8 8 12 
‚510220 82 Ц? 8 Д 2 
. 50000 161 82 jo | | 12 
‚50000 24 ibe 0 5 2 
. 19333 15 37 3 9 7 
‚49180 61 30 Ц 6 2 
‚48649 zu 36 6 3 6 
‚417423 97 46 8 Д б 
„Шү оо 36 у ЈЕ Ц 5 
055 73 34 5 5 4 
. 46000 50 23 - В 1 5 
. 45652 92 ШО 7 lj 6 
. 45455 ЛО 55 Д 12 15 
. 45455 ДЦ 20 H 2 0 
‚45378 119 54 6 My 8 
. 44828 58 26 3 6 2 
‚44615 130 58 6 ae 11 
‚414262 61 27 Ц 3 5 
2057 21 9 al 2 i 
. 42553 94 40 6 Ц б 
„42424 66 28 Д 5 2 
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TABLE Will. 

Sy Мк 
. 42169 166 
. 41975 81 
ДИО 60 
‚41319 87 
ІШЕГІ 56 
. 50476 42 
‚40299 67 
‚40000 65 
.39726 I 
‚39216 51 
‚ 38562 153 
20298 47 
2 Sr 58 
. ТӘ 90 
2305 61 
2090593 145 
31255 192 
. 36667 30 
20205 41 
26207 58 
«29550 90 
‚ 35291 7 
-34211 38 
. 33594 128 
22553 51 
. 32632 95 
„32500 10 
. 32168 ит 
2354579 19 
251213 sal 
25126) 18 
. 30769 39 
.30769 39 
-30645 62 
‚30435 ТІНЕ 
29921 о 
2967 24 
oo, 326 
‚28947 38 
ao 28 
2025 160 
. 28090 89 
¿21000 47 
‚27586 29 


SCORSORT SUMMARY (Continued) 
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155 
134 
Шо 
136 
Г 
158 
1:512 
140 
141 
142 
143 
144 
145 
146 
147 
148 
149 
150 
tol 
үзг 
Ша 
154 
155 
156 
1 
158 
10222 
160 
161 
162 
163 
164 
ESO 
166 
SIT 
168 
169 
170 
Ey 
l2 
Што 
174 
175 
176 
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TABLE VIII. 

Sk Мк 
‚27273 11 
ИСЕТ 5" 
‚26923 52 
· 26667 60 
‚26563 64 
ДЕБЕТ П 
‚25385 130 
со? 71 
‚25287 87 
‚25225 na) 
„25000 80 
„25000 36 
‚21528 53 
.2444y 45 
ЗО 145 
Ко ое 1 
. 23891 ме 
za) 97 
23501 47 
‚22917 96 
‚22807 57 
22335 Ца: 
„22222 ДБ 
‚22222 45 
‚22059 68 
‚21875 61 
MONDO T 60 
iol 61 
‚20690 29 
20000 "E 
19512 123 
SERES 93 
‚19048 Д2 
‚18033 Sn 
ГО 45 
17500 40 
ЭЭ 3:2 
117241 58 
20608067 83 
16774 155 
.16667 54 
„16585 91 
eo 62 
15225 32 
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l 
178 
КО 
180 
181 
182 
183 
184 
05 
186 
187 
188 
189 
190 
191 
192 


o 


194 
195 
196 
ШЕН 
198 
145 
200 
сот 
202 
203 
204 
205 
206 
207 
208 
209 
e210 
211 
= Пе 
213 
214 
2 15 
216 
га 
ЕШ? 
219 
220 
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TABLE VIII, 

Sy Ny 
. 1554 59 
ЖЕГІ 46 
‚14474 76 
габ 188 
‚14286 14 
. 1357125 51 
2128053 БЦ 
.12500 64 
. 12088 91 
. 12000 75 
. 11905 Ц? 
‚147705 Гү 
ET 60 
.11570 121 
. 115 0 26 
ШЕШЕНДІ 139 
er) 63 
ETT 15 
. 10909 120 
10911 71 
. 10280 207 
осо 59 
. 10169 59 
. 10000 70 
-10000 ЦО 
‚09804 102 
.09756 41 
. 09459 zu 
. 090434 53 
‚09346 107 
‚09302 13 
.09091 17 
‚ 09091 55 
200009. 33 
209] 33 
‚08889 90 
08725 149 
‚08571 70 
“05511 47 
‚ 08475 59 
. 08333 112, 
‚08235 85 
‚07602 39 
‚07692 26 
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22l 
22 
223 
224 
225 
226 
2200 
228 
229 
2 510) 


ра 


252 
5 
234 
255 
236 
РГ 
238 
822 
240 
241 
242 
243 
244 
245 
246 
247 
248 
249 
200 
251 
252 
e 
254 
255 
250 
РЕ 
2 
2519 
260 
261 
262 
263 
261 
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TABLE VIII. 

Sx NK 
20125026 66 
‚07500 80 
О 68 
200939 150 
.06897 58 
205557 30 
‚06410 78 
06250 32 
‚06250 32 
‚06000 50 
Бе 108 
205351 56 
ОБ о 58 
04762 105 
‚01545 22 
O44 90 
. 04324 185 
04317 139 
04167 18 
03704 51 
. 03676 136 
03686 55 
O CIA 83 
. 03601 ны! 
«0,3590 59 
03279 61 
‚03261 92 
‚02778 Т 
‚02703 7l 
30203 D 
‚02632 38 
02564 39 
02326 13 
01818 ББ 
оо 56 
‚ 01449 69 
. 00990 101 
00926 108 
00714 140 
‚00000 100 
‚00000 91 
‚00000 89 
00000 85 
00000 71 
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265 
266 
267 
268 
269 
270 
N 
a2 
25 
274 
сай 
276 
277 
278 
= > 
280 
281 
282 
283 
284 
285 
286 
287 
288 
289 
290 
291 
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TABLE VITI; 


к Ny 
‚00000 67 
‚00000 В 
00000 on 
00000 58 
00000 57 
00000 Я! 
‚00000 50 
00000 49 
00000 39 
00000 38 
00000 38 
00000 34 
. 00000 34 
‚00000 32 
00000 2 
‚00000 29 
. 00000 27 
‚00000 26 
‚00000 26 
‚00000 2l 
. 00000 23 
‚00000 22 
‚00000 22 
00000 22 
‚00000 20 
‚00000 14 
00000 3 
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Expression (1) states that a first place vote should be 
welebted higher than a«*seconde place vote, which in turn should 
be weighted higher than a third place vote, and that all 
wesphts be greater than zero. 

A second set of restrictions on the weights logically 


would be that no two weights be the same or that 
W, А W4 sp i (2) 
W/W, < 1 *» 
therefore from (1), (2), and (3) we have 
0 < A <: 1 
0 < ШЕР < 1 


Now letting (a4 ,b4) and (85, b.) define a preferential region 


interior tO Che unit square then 


© 
A 
ро 
A 
A 
oO 
A 
pas 


7 = 


c 84/4 < b. < 1 
The values 
ај ис WAS 
b; - b, = 2/3 


were used as acceptable parameters based on a determination 
of the smallest and largest ratios acceptable for the three 


weiches. 
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2, Absolute Dominance 
If K and K' denote any two teachers, 5, and Эк! аге 
their respective scores from "SCORSORT" then it is desired 


ina аш alues of W such that 


S, > S ot 


K ¡ON 


eherefore by substitution, 


Wy Vax t Wo Voy + ШАД, 2 W Vip t W Vogi t ЈЕ Уақ! (4) 

ОР 

LN К Км) = Yon Na) 29 99 
Then teacher K is absolutely dominant over teacher К' 

when V - V О авы спен е Б and 


LK Ir K К! 


teacher K' can be eliminated from the competition. 
3. Complete Dominance 
Пете Гог о оное. сор ее dominance 
eliminates all teachers who in order to win must have a 


Weighting system that violates Wa > W. > Wo. 


Prom (5) 
Wy ше 
я» Vax > Vago) + Ору“ Ур) + d (зк з Vgı) 20 (6) 
Or 

М | Va лү», | Vox = Vogr) 

АИ аи o па 


BS 





ШКОЛЕ leo relationship is determined by Wi > W5, 


and W3 о. Vix and Vix dare Known. 


Letting Y W. / DIS Y, / W, and noting that 


З 


D Sond. X Lernen leCTING 


| V 





i E IS Vane? 
B = - (Уу әк) 
С = VER - Vax! 
а " š . AOS B 
and substituting into expression (5) we have Y = — Т 
which is the slope intercept form for a line. 
dd 
|| — 
Г Р 
: 1 2 3 


Figure 2.  DOMINANCE PLOT 


ce CAS aA DIOL OL TVS мер the feasible repaso 
shown for the weights. Teacher K is completely dominated by 
кваспен KT! TT either 
PEE c от ама“ Y(1)99 1 С> 0 


РО о 0 pee 





И О and 1 


b) -А = 0 and -B < 0 


4, Results 
Table IX presents a summary of the dominance tests. 
Тк’, Va ko У ко апа Уақ ои еп идеш шероме. лр and CD are resultes 
of absolute and complete dominance. A one indicates that a 
шак а ос аита тере іпатсасев а сеасһег 18 not 
Omina ced eras Not been eliminated. 
After screening for absolute dominance only 4 teachers 


out of 279 remained in contention, and the complete dominance 


reduced this number to two. 


б, COMPARISONS 

A Fortran program called "COMPARISON"! compares the scores 
of the Ith teacher against that of the Jth teacher with the 
Constraint that each of these teachers is known by a given 
voter. The study compared the twenty teachers with the highest 
Score {rem SCORSORT with each other. 

еу SEeore for each paired comparison was based only 
ОШО КОК 5 о о ар оп Ol voters that identified both teachers: 
The teacher ranked first in "SCORSORT" would be expected to 
шаша overzalzorher teachers, and the teacher ranked last 


would be expected to lose to all other. If the first teacher 


ГА Jl ОГ COMPARISON SP n C Inded in Appendix В. 
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.215 
‚229 
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.198 
‚189 
. 284 
ЗЕ: 
217 
г 
so) 
а 
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70 
E 
219 
.169 
Mu 
45 
115 
.196 
.164 
2425 
5122 
аша 
105 
. 190 
se 
. 129 
. 158 
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SU 
Eo 
213 
. 068 
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SAUT 
· 097 
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DOMINANCE TEST RESULTS 


Vox 
216 
2052 
207 
2462 
10 
11219 
‚145 
150 
E 
21199 
ао, 
‚027 
И 
О 
ale 
“107 
NE 
-187 
аба 
‚115 
„О ү 
. 108 
ВТ 
E 
ol 
20209 
‚086 
‚151 
· 109 
zent 
ОГО 
. 038 
AOL 
129 
O77 
.089 
ЭШТЕ 
m 
ABE 
100 
.140 
102 
‚143 
оса 
205 
SI 
. 068 
. 014 
007 
541272 
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BL 
‚086 
O 
2074 
ae 
0 
.043 
„133 
. 105 
093 
Mop 
‚ 054 
116 
o 
2005 
036 
ZOTO 
‚088 
EE 
ESO 
. 026 
ND 
205m 
аса 
‚080 
ers 
. 069 
. 081 
. 065 
22339 
Коо 
‚036 
‚136 
UD 
вада 
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2079 
m 
ШЕ 
‚145 
"XS 
055 
‚036 
. 052 
. 067 
ee 
. 082 
210112 
‚ 049 
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МЕГЕ (о lose in any of the tests then significant argument 
nent Dé made mor Sivine “unecwaward to another of the high 
tanking teachers. 

e a a e epar ed comparison analysis for the top 
twenty teachers were computed; however, since the teachers 
Beeren OCO се dominant, violated the constraint that 
о в On, Che results did not enter 


into the final selection process. 
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e THE SELECTION 


ВО о те obtained, a set Of Statistics 
риа аа presented Co this years selection committee. 
its presentation included: 

Еее сце voting population 
СО Бка сеа results of all computer programs 
Bere Ист тешке Tests 
4. An abstract of comments from all ballots in which 
the individuals passing the dominance tests had been 
deca eds 
Following the above presentation, the committee voted unani- 
mously for teacher number one. 

Thes#inmers Mame was forwarded to the Academic Dean and 
Superintendent and will be made public at the June graduation 
Ceremonies: 

Toe eae Oa vidual teachers Concerned were unknown 
to the selection committee throughout the process. At the 
time the above ballot results were revealed, the only name 
auum (q пасош the winner, which will continue to 


CSS шара ено а al ue ereaduation ceremonies. 
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VI. RECOMMENDATIONS 


As was noted in table I, alumni and faculty show an 
пась сасна vile percenta ee Ol Voters over the previous years. 
some possible causes for the decrease in students response 
Mel. De “atbributed to 


IAS аса сол of the ballots was such 
chatschesvorınewerrerdedesover an exam period. 


2, The Tone response time given to students may have caused 
sen a, FO Phe OLuerosponding, thus, causing them to 
LOrE Cepot re ponding altogether. 

3. It was possible this year due to a special letter which 
ШӘ l оса О Cie alumi: ballot to correct ballots 
уст то labeled as students, but definitely from an 
ПО i On MC OI e eted. This problem of alumni still 
Tjera n Gq i S 1S Obviously a reoccurring 
problem and a more meaningful statistic would be a 
Son цмока. ald students together. However, 
ЕЕ Сое гоне понес а decrease in response. 

lieu ccecenmmaerecmchodl!dosconuswder shortening the response 
mano, avoneanesexam periede, and redesigning Part A ol the 


ballot so as to eliminate common errors made in voter statistics. 


A. REVISION OF PART A 

ThE DI GDL OL ballots with no voter category was eliminate 
this Ser рпа у because the ballots ror different groups 
vere printed at different times. With the small changes which 
were made it was possible in many cases to identify voter 
CEE Evel IT iC were lert blank. However, the problems an 
blank voter category 1s one which Stila’ must be solved. The 


possible causes listed here are: 
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Ni ЕТИ Соер спе voter category were 
Vee аша вас аве се”, 


жәме нов пап TG Cake Cime to fill out Part A. 
Der мава нс ана го Бе identified. 

Of the above, the most likely explanation concerns the 
instruction sheet. The reference to Part A was given in 
әмер гл пе ке описе опао elven in Fart A proved to be 
inadequate. Major mistakes were 


Е S / Baculty / Cúericular Officer 
seebaon —earcleg wrong choice. This could be 
eliminated by having instructions which state: 


YOU ARE PRESENTLY A (CIRCLE ONE) 
3 эрас і 

A Alumnus 

F Faculty Member 

(СИЕ тшеп дг (04; асег 


г. Rank — In many cases this was circled to indicate 
branch of service. (01 was circled because it was 
to the left of N Navy). This accounts for the large 
number of ensigns which were recorded as having voted. 
änstrutelıons such as: 


(Military only circle your present rank) 
Sal 02 03 04. 05 06 Oy, 


Should eliminate this problem area. 


3. A common problem was that civilian students were 
СОП ГОС ООШ CO шалар аәрез (0 clrcle.. Most of them used 
the area meant for faculty because. itl was labeled 
Civilian. A possible solution would be relabeling and 
Adde Aa Oer Cater oi Civilian under branch of 
SerVrec. 


TTC would space OO Ml re о на + my suggestions 


were incorporated: 


AL - (A11) You are presently a (Encircle one) 
S Student | 
Alumnus 


A 
F Faculty member 
6, Curricular Officer 


НО 





А2 - (Military Only) 


A = (A11) 


01 02 


Your present rank is: (Encircle one) 


03 


04 05 06 07 


(Encircle code at left) 


Students/ Alumni/ Curricular Officers 


Branch of Service 


C Civilian 30 
N Navy 5] 
M Marine Corps 32 
C Coast Guard EE 
A Army 34 
L Air Force 35 
F Foreign 36 
3f 
38 
59 
Faeulty 

Posicion 
IE сара рыса З” AE 
AT Assist Prof AO 
аа ас. ГОР MN 
PR Professor EE 
GH 
MC 
MA 
ME 
MR 
DE 
OA 
PH 
NS 


B. COMMITTEE RECOMMENDATION 


Curricular Area 


Ops Analysis 

Aero Eng 

ВЕС COMM ENE 
Ordnance 

Naval. Eng 

Env Sci 

Mange & Compt Sci 
ENE SCI 
Baccalaureate 

Def Management 


Беда се» 


Aeronautics 
Aviation Safety 
Bus Ad & Econ 
Ele THE 

Govt & Human 
Мар SCE E Саси 
Math 

Mech Eng 
Meteorology 
Oceanography 
Ops Analysis 
Physics 

Navy Mange Sys Center 


7 


This years committee has recommended that in the future 


а шила from the selected year also include U. S. Marines, 


а Nii Forcea andor eign Officer graduates. 
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MERA TAE A LYSIS 


with three years of data to work with some questions 
Conce cane trankilo teachers coula be examined. 
паа uj j ааа спав со rank teachers Similarly? 


o j | ана eso teachers by students remain fairly 
constant [rom year сее а? 


These questions are addressed is subsection A. 


A. CONCORDANCE ESTIMATION 

Using а: coefficient of concordance, the degree 
Of resemblance between two sets of data can be determined. 
ar themeset Tjerent iis СТВ о ССИ ие two data sets show 
Sitar fences, Ihe further the coefficient is from one 
n ОК с с ее Екпе Tess Che смо 5655 resemble 
Б LS ENS I кс GPO y bezuseatto determine It a 
teacher which is ranked high by student voters would also be 
пописа hire by alumni. 

по Ot коле rankings of teachers 
ае КАТОС NOT OY dC ICS 10 ое [rom each group. "The 
first row is the ranking of the teachers by the alumni and 
О т ranking by che students. 

Kendall defines the relationship as 


T(S) 


а ANA 
en a 


TEE M. G.; Rank Correlation Methods, 2d e., p. 3-11. 
94-100, Griffin, 1955. 
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Kl ШШ Ке ое гу Оет of concordance, m is the number 


Qu raters, Mets. thermmrber of rankings, Sis the total sum 
of squares of actual deviations, T = КИ ee ande 
indleates number of ties of length i. 

A computer program was written which computed all values 


from the table. Its results indicated that 


12 (1368609) 
М = = .7690 


(OX a КО EN CER S o и ззош) 
Mae ови сатсе о: Wiemay be tested using Fisher's? 2 


MEAN 
1-М 


ee ee dom Tor consultas the 2 table, ape 


3 


ШӘ ІНЕ 2 = 172 Tog, = .6013. The appropriate degrees 


N 


It 


c 
(n-1) - rg 15 


V 


2 (m1) “ У. = 173 


al 


and the appropriate value of Zin the table is .125 for the 
5% level of significance. Since the calculated value of 

Z = .6013 is greater than the tabulated test value, W is 
оге ени „саде у О rerent Ітоп zero, This indicates 
кам p Telecel the hypothesis that the rankings оу the 
students are unrelated to those of the alumni. A teacher who 
is ranked high by students will also tend to be ranked high 


by alumni. 


Fisher, Dee cd ОЕЕО САС Стал Tables; p=up pP 
Hatrner.21957. 
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A second study was conducted to determine if rankings 
О The faculty were stable across three different voting 
populations. All teachers which were eligible to receive 
the Award for Excellence in Teaching and were known by at 
least ten students in 1970, 1971, and 1972 voting were ranked 
ру (пе students from each year. 

Пана о исх Ol the rankings of each 
Beschen, Tne lirst though third rows. are the rankings of 
MEDRESE trom 1970, 29 77, sand 19/2 respectively. 

Again using the coefficient of concordance and the new 
computer program the results indicated that 

LE A 


D --— NM аа S = OS O 
(3)* ((105)? - 105) (12 * 3 * 6) 


nc T W 


апа 2 = 1/2 log, we 


= ,2967 


The appropriate degrees of freedom for Z2 are 


Ga=1) = = 104.3 


1 


У 


SIN 


1 


У 


1 


(m-1) + V = 208.7 


2 1 


TNE appropriate value of Z in the table is .136 for the 
5% level of significance. 

и тео ао аще о: 2 - Ar iS, greater ўвай 
the test value, W is significantly different from zero. This 
again indicates that the rankings of teachers was not random 


and that a teacher's ranking was stable across years. 
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СОМСОКРАМСЕ MATRIX 1 


























TABLE X. CONCORDANCE MATRIX 1 (Continued) 
























































Alumni 64.0 65.0 66.5 So 68.0 69.0 
Seucent 570 97.0 pM D КОББ 15.0 12325 
Total 117.0 о 101.5 quis) D 192.5 
Alumni 210.20 0 эн 73.0 О 75.0 
Student СЕГО ПО 1170 OO 12.0 89.0 
Total О 188.0 2 20670 2020 85.0 167.5 
Alumni {О O nm. ПЭ 79.5 ОО 
Student 9/0 39,0 ОО -94.0 12,5 13820 
Total 158.0 J OPO 80.0 ТЕСТЫ eee 0 219020 
Alumni 82.5 82.5 84.5 84.5 86.5 86.5 
Student OD TORO 0 00.0 105.0 55.0 
Total L500 TOOTO 158.5 71.5 189.5 141.5 
Alumni 88.0 89.0 90:5 ШЕ 9270 950 
ПРО. 100670 TULA 156.5 164.5 аса 148.0 
ога: 196.0 199.0 22.0 Doo) = 1606 DUG 
Alumni 94.0 БО 96.5 96.5 98.5 98.5 
Student О noe U0 99,5 85.0 15.0 
ocal О о E equ IST 183.5 143,5 
Alumni 10020 ео 19220 MO: 204.0 1O50 
Student 164,5 41.0 88.0 66.0 164.4 131008 
Total 264.5 14790 J 90. Ü 169.0 268.5 23900 
Alumni 106:0 107.95 10725 10955 1005 J ав 
Student И.О JM 16.20 49.0 47.0 ] 0550 
otra |: Tos. Иа HE 158.5 156.5 1 
Alumni ЕО 182565 mon 115,20 116.0 T 
Student ONO 92.0 ЕН 300 IO 12220 
Total Ze 201.5 lI 259.0 22730 29.0 
Alumni о 179.09 T2075 120,5 12270 123.0 
Student 164,5 dog 3/0 96.0 БО J 5 Ў 


Total 282.5 217.5 ЕЕ UT 178.0 256.0 
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Alumni 
ӘТЕШ ет 
Total 


Alumni 
Student 
Шора: 


Alumna 
Student 
Rota] 


Alumni 
Student 
Total 


Alumni 
Sstugent 
Total 


Alumni 
Student 
Ката. 


Alumni 
Student 
Total 


Alumni 
Student 
Total 


Alumni 
Student 
Toral 


TABLE X. 


NDS 
98.0 
22-5 


143.0 


218.0 


160.0 
т ш 
286.0 


160,0 


164.5 
321,5 


164.5 
324,5 


NDS 
44.0 
Шос, 5 
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164.6 
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CONCORDANCE MATRIX 1 (concluded) 
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TABLE XI. CONCORDANCE MATRIX 2 







































































Sendents '72 0 20 3.0 Д0 5.0 6.0 
Students '71 36.0 500 Sau 0 95.0 20.0 
Students '70 1.0 10:0 2.0 8.0 TU 25.0 
Total DON 59.0 36.0 19.0 J07,0 SEO 
Students '72 "aee 3.0 C 100 AO 12.0 
ents '71 44 .0 ° 0 6.0 ШТ) IE 3080 
Seugents '70 L0 1:0 50 SEED. LOO 23,0 LOTO 
Total 64.0 106.0 195 21.0 81.0 CONO 
Students '72 1250 PUNO Jo 16.0 10 LORO 
Sesdents '71 а 19.0 OO 2.0 33.0 38.0 
Students '70 36.0 Se 220 LAO O ТОО 
Total 65.5 38.0 120209 E ОО 220 
Students '72 19.0 2000 2E 22.0 23.0 24.0 
students '71 SO Lone © ана {2.0 1 0 29.0 
students '/0 200 O 33.0 PRO 34,5 120 
total 98.0 166.0 72120 105-0 Оо 65.0 
Soudents. '72 25: 0 AO 27.0 280 29.0 SO 
Students '71 | 600 20 48.0 80.0 1920 1020 
Students '70 ІШЕ 2 2200 PIDE) 19.0 44.0 24.0 
Total 02,0 T.O One ey 91.0 о 
Students '72 SLU 50 5 515 5 see) or 36.0 
Semgents '71 66.0 52.5 2L0 АЦЕ 8.0 82.0 
пене. '70 102 m 37.0 260 ee; 58.0 Ho 
Total 199.0 W215 80.5 MO ОЕ. О 1590 
Sendents. '72 37.0 38.0 39.0 10.0 ШО on 
Sendents "71 92.0 O 10.5 84.5 56.0 TOTO 
Students 1770 52.0 39.0 6.0 29.0 93.5 69.0 
Total Io Bel 148.0 85,5 152325 1908 12120 
Students '72 43.0 44.0 45.0 46.0 47.0 48.0 
Students '71 O 90.0 bes 32.0 63.0 7H0 
Students '70 00 O O uoo 61.0 98.5 
Total 190.0 219.0 L757 156.0 LIU 220.5 
C D 172 49.0 50.0 51.0 52.0 53.0 54.0 
Students '71 7220 0 89.0 750 26.0 19,0 
Students '70 О 12.0 91.0 20.0 100.0 101.0 
Total 199.0 97.0 23170 nyc 179.0 201 
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TABLE XI. 
Students '72 
Students '71 
Students '70 
Total 
Seudents 'T2 
Students "ГІ 
Seuaencs 'TO 
Total 
Seudents ‘fe 
Spudents.-'71 
Seudents '70 
Total 
Students. '72 
Seudents '71 
Students. '70 
Total 
Seudents "72 
Ss udents '7] 
Students ' 70 
Total 
Students." 12 
students "71 
Serdents 72 
Total 
Students T72 
Students '71 
Students '70 
Total 
Seucenvus 8) 2 
BSeudents”" 7] 
students. "70 
«Total 
Students '72 
Seucents “71 
Students 770 
Total 




















49 

















TOSO 


104.0 
Бе 


CONCORDANCE MATRIX 2 (Continued 









































APPENDIX A 


THE REAR ADMIRAL JOHN J. SHIEFFELIN AWARD 
FOR EXCELLENCE IN TEACHING 


In order to augment tne existing incentives for teaching of high 
quality, an award for Excellence in Teaching has been established by 
the Superintendent. A substantial stipend was made possible through 

gift to the Naval Postgraduate School Foundation in honor of Rear 
Admiral John J. Shieffelin, USI. The judgments of those who have 
participated in the educational processes at the Naval Postgraduate 
school are of primary imporvance in determining the recipient. This 
Poll is being conducted to assess the collective opinion of students, 
faculty, staff, and selected alumni. After accumulating and processing 
the voting results, the Selection Comnittee will recommend an Awardee 
to the Superintendent. 


N 


A meaninsful selection of the Award receicient is heavily dependent 
ipon input Iron a larzgerrortıcen of E eliciole voters. Your response 
is therefore earnestly requested. lease complete the enclosed 
ballot in accordance with the оуу ns below. The results of the 
polling, other than the nane of the Award recipient, will be treated 
as privileged information. 


BALLOTING PROCEDURE : 


Step 1. Complete the information requested at the top (Part A) of the 
ballot. These items are for purposes of statistical analyses 
only. 


ep 2. Оп (йа 1150 oni TO TO К nt O WPOiciycle the 
four-digit identification nunber at the left of all those 
with whom you are suiticiently acquainted to make 2 judgment. 
For purposes of establishing a valid population base, it 
is important to encircle el} with whom you are acquainted. 
Tf you have circg@ed itive cr cr mere numbers on the ballot. proceed 
to Step 3. Otherwise, please return your ballot as directed 
аер. 


а 


Step 3. From the subset of faculty you have indicated in Step 2, 
select from one (1) to three (3) nominees. Indicate your 


/ 


prelerences in orden. oy placia Lie тС qisyt identiz “ication 
nu ors Ol cur ы ел Го Bere and third choices 


in the appropriate стасез orovimed in В. 





Step 4. You are invited to furnish a short statement in support of 
your primary nomination. Indicate those qualities which, in 
your judgement, make nim an outstnading teacher. Space is 
provided for this at the end (Part D) of the ballot. 


Step 5. Place your completed ballot in the enclosed return envelope, 
Siem the envel@se ап? return. ee Ca ballots tust be 


received = 24711 1572. 5341979 -iL beo seraratefi from 
the envelopes. 


~ 
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BALLOT 


Part A - Statistical (encircle code at left) S Student 


A Alumnus 


F Faculty 


C Curricular Officer 
Voter Category 


Military Civilian 
Rank Branch of Service Curricular Area Rank Department 
01 N Navy 30 Ops Analysis IR Instructor АЕ Aeronautics 
02 M Marine Corps 31 Aero Eng AT Assist Prof AO Aviation Safety 
03 A Army 32 Elec & Comm Eng AC Assoc Prof MN Bus Ad € Econ 
ou C Coast Guard 33 Ordnance RP Professor EE Elec Eng 
05 L Air Force 34 Naval Eng GH Govt & Humanities 
06 F Foreign 35 Env Sci MC Mat Sc & Chem 
07 36 Mange & Compt Sci MA Math 
SM ERE SC ME Mech Eng 
38 Baccalaureate MR Meteorology 
39 Def Managenent OC Oceanography 
OA Ops Analysis 
° PH Physics 
Part B - Nominations (use the four-digit identification number) NS Navy Mange Sys Center 


First Choice Second choice Third Choice 


Part C - List of Eligible Faculty (i.e., all faculty who taught two or more course segments in calendar 
year 1971, except Department Chairmen, Curricular and Liaison Officers, members of the Selection 
Committee and past recipients of the Award. 








Aviation Safety Programs 1636 Gardner, E. М. 1986 Pearson, L. W. 2323 Kodres, U. R. 
1015 Bomberger, R. В. 1647 Geist, J. M. 1997 Smith, B. M. L. 2334 Kolitz, В, Г. 
1025 Bradbury, C. M. 1658 Gerba, A., Jr. 2017 Teti, F. M. 5166 Kovach, L. D. 
5016 Brenson, J. J. 1669 Houston, R.K. Department of Material 2367 Lucas, K. R. 
1047 Wible, L. C. 1670 Kirk, D. E. 5 2378 Marks, H. B. 
Department of Aeronautics 1681 KXlamm, C. F., Jr. 2028 Clerk, J. R. 2378 Morris, G. W. 
5027 Bank, M. H. 4035 Knorr, J. B. ren} 2390 Pierce, J. P. 
1069 Bennett, J.A.J. 1692 Marmont, G. H. 2040 Hering, C. A. 2417 Pulliam, F. M. 
1070 Biblarz, O. 5072 Menneken, C. E. 2062 Leonesio, A ps 3971 Ramanujam, H. R. 
1081 Collins, D. J. 1708 miller, R. L. our 5177 Rice, B. 

5038 Fuhs, A. E. 1720 Myers, G. A. . eng 2428 Roberts, A. B. 
1092 Gawain, T. H. 5083 Myers, H. L. 2063. Beynolds, M. F. 2439 Schoenstadt, A. L. 
1108 Haupt, U. 1753 Panholzer, R. о о 2451 Shorb, A. M. 
5049 Hess, R. A. 1079 Powers, J. P. ОООО r: 2462 Singer, E. A. 
1110 Kahr, C. H. 1080 Powers, V. M. у elo c 5188 Singer S. 

1120 Layton, D. M. 5094 Price, T. G. м” 2473 Spalding, J. H. 
1131 Lindsey, G. H. 1764 Rahe, G. A. с еен: 2484 Stewart, E. J. 
1142 Miller, J. A. 1775 Rothauge, C. H. Pepe A Stoops O 
1153 Netzer, D. W. 1786 Sackman, G. L. о 2501 Syms, G. H. 
1164 Platzer, M. F. 1797 Sheingold, A. nun 2512 Trahan, D. H. 
e A 1803 Smith, W. C. a ue e 2523 Weng, P. C. C. 
1175 Вед1іп, М. Н. 1814 Spaugy, Ф. А. 2156 Во11ев, К. С. 2534 Weir, M. D. 
1186 Schmidt, L. V. 1825 Stentz, D. A. 5144 Brubaker, В. Н. 2545 Wilde, C. O. 
1203 Zucker, R. D. 1836 Strum, R. D. 2167 Budway, J. J. Department of Mechanical 
Е ет 1857 Terman, F. M. 2189 Chewning, W. C. Engineering 
Engineering —  — 1858 Thaler, G. J. 2190 Comstock, C. 2552. Brock, d В 
1481 Adler; R. Y. 1869 Titus, H. A. 2206 Davis D. L. 2567 Cantin, G: 

5061 Bach, R. oe О 2217 Dixon DR. 2578 Cooper, TER 
1508 Bauer, W. M. EG oT 4057 Draper, R. A. 2589 Garrison, C. J. 
1519 Ваусига, 0. М. 1892 Wilcox, M. L. 2228 Estell, R. J. 2590 Houlihan, T. M. 
1531 Bouldry, John M. Пее б ОО Сыл 5155 Evans. R., M. 2606 Kelleher, N. D. 
1542 Breida, S. and Humanities 2239 Faulkner, F. D. 2617 Marto, P. J. 
1553 Campbell, J. D. 1919 Amos, J. W., II 2240 Franke, R. 2628 Newton, R. E. 
1564 Chan, S. 1931 Boggess, W. C. 2251 Giarratana, J. 2639 Nguyen, р. Н. 
1575 Chaney, J. G. 5100 Caldwell, D. E. 2262 Gibbons, G. D. 2640 Prowell, R. ¥. 
1586 Cooper, P. E. 1942 Gabel, B. B. 1091 Hanna, Б. М. 5199 Pucci, P. F. 
1597 Cotton, M. L. 1953 Gottschalk, S. 2295 Jeyackanäran, T. 2651 Salinas, D. 
1603 DeLaura, R. D. 196% McAdams, J.M. 2301 Jennings, W. 5200 Sarpkaya, T. 
1625 Ewing, Gerald D. 2312 Kildall, G. A. 2662 Winfrey, R. C. 
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Department of Meteorology 


2673 
2684 
712 
2723 
7211 
2745 
2756 
2767 
2778 
2789 
7001 
3915 


Albertv, R. L. 
Davidson, £. L. 
Elsberry, В. L. 
Hamilton, H. D. 
Haney, R. L. 
Mantin, Fu La 
Oakes, W. B. 
Bchardt, D. E: 
шаб, E. La 

Чап der Biljl, W. 
ва ы Это. К. І. 


Kinnınshoff, F. J. 


Department of Oceanography 


2806 
2817 
2828 
5222 
2840 
2851 
2895 
5233 
5244 
2912 
0923 
2934 
2956 
2267 


Andrews, R. S. 
Bassett, C. H. 
Boston, %.E:J. 
Bourke, R. H. 


Denner, Ww. VW. 


G Je J. A. 
uno, С. Н. 
Knodle, W. C. 
poberts, C. K. 


Thompson, W. 


C 
Thornton, E. B. 
Traganza, E. D 

J: 


von Schwind, 524 


Wieklıam, 1. В. 


Department of Operations 
Research and Administrative 
B'erces 


2978 
2989 
0066 
2990 
0105 
3010 
5021 
3032 
3053 
1214 


Andrus. à. Р. 


arima, J. K. 


Barden, R. S. 
barr. D. К. 

Ведом, К. J. 
ВЕР, Е. A. 


Butterworth, R. W. 
Burnett. I. D. 
сарга, ака 
Carrick, Pp nN: 


1225 
0077 
4013 
3054 
1247 
1258 
1269 
3076 
3098 
3115 
3104 
1220 
1281 
3126 
1292 
1308 
3148 
4091 
0011 
3160 
3171 
0088 
1319 
3182 
1320 
1331 
0099 
3948 
1353 
1364 
3232 
1375 
3243 
3265 
1386 
3254 
3276 
3287 
3298 
3304 
0116 


Church, W. 


HE 


Courtney, D. 


Creighton, J. М. 


Cunningham, W. Р. 


Darbyshire, L. 


Eisenhardt, P. 


Elster, R S. 


Есзагтус із Бы 
Floyd, 4. А. 
Forrest. Ren. 
Free, VW. D. 
Fremgen, J. J. 
Ganz, G. 
Самет, D. P. 
Githens, W. H. 


Grainger, T. L. 


Greenberg, H. 


Hanna, M. 


Hauser, 


Heidorn 


NY 


ate 


> 


DOE. 


Higgins, J. E. 


Norton, 


b 


36. 


Hoverland, H. A. 


Howard, С. Т. 


Hynes. Т.Р, 


Jolie A. 
Kings 6G. J. 


кііпе, rl. 


Lande, R. S. 


Lane, 


Larson, 


Lee 9 м “ 


Н 


BE 


Н. 


· Ј. 


H, 


Lindsay, CG. F: 
Marshall, 


McDonald, 1211. 


McMasters, 


KT. 


А. М. 


Hibch, P. RE 


Peterson, C. A. 
Peeck n С. К 
Ртевсоп, Е.Б. 
Raike, М. М. 


3987 
3315 
4046 
3326 
0127 
3348 
5982 
0138 
3360 
1425 
3382 
0149 
3409 
3960 
3410 
0150 
1458 
0161 
0172 
1470 
342] 
34 32 
344 3 


Read, R. R. 
Richards, Е. В. 
Schrady. В. А. 
Senger UCD. 
Shubert, B. O. 
Shudde, в. Н. 


Sontheimer, K. 


Steckler. ob J. 
Taylor IG. 
Thomas, M. U. 
A 
Uhler, R- IS} 
Washburn, АРКЕ 
Маѕѕепааг, 
Wegener, W. Н. 
В... 
Whipple, D. 


Weitzman, 


Womer, N. K. 
Woods, W. M. 
Zehna, P. W. 
Zwoipg ela i 
Department of Physics 


3454 Armstead, R. L. 


Schneidewind, N. 


Sovereign, M. G. 


Dos 


0194 Maruyama, X. K. 
3621 Medwin, H. 

SES SGOT lane, E. A. 
3643 Neighbours, J. R. 
3634 Olsen, Ре О: 
3665 Reese, Ы. 
3676 Riggin, J D. 
3687 Rodeback, G. W. 
3698 Sanders, J. V. 
3704 Schacher, G. E. 
3715 Sehwirzke, FI R: 
3726 Williamson, T. J. 
/012 “Wilson, 0. B. Јер 
3737 Woehler, K. E. 
3748 Zeleny, W. B. 
Navy Management Systems 
Center 
3759 Blandin, Sherman V. 
3760 Boynton, R. E. 
0200 Callahan, J. F. 
0211 Campbell, W. A. 
3782 Childs, FEE. 
82722 Dawson; JW E. 
3809 DeSerpa, A. C. 
3510€ Doran, E. XJ. 
3821 Freed, E. J. 
3854 Mauer, W. A. 
BEOOR PRIO COIN №. 
3876 Puscheck, Н. С. 
29907 Ulrey, Г. В. 

NIS 3887 von Pagenhardt, R. 
3905 oo G C. 1. 

Jr. 


3005 BUSKIRK VE В. 
3476 Ceglio, №. М. 
3487 Cooper, A. |. 
3498 Cooper mu, 
3504 Coopens, А. В. 
dol» Crittenden MEAC: 
Зорб Е пак: NS 

UISS Dall. EB 
ЗЭЭ Мес А, Г. 
35483 Garrettsou,fG. A. 
3559 Handler, H. E. 
0007 Harrison. D. Es, 
ЗЕ Коба S.H. 
3967 Kelley, Re h. 
3005 Lipes. R. G: 
3610” Little, We 


Part D - Supporting remarks for your primary nomination (optional) 
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